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DISPLAY DEVICE AND SYSTEM 



FIELD OF THE INVENTION 

The present invention relates to portable digital image content 
display systems having local storage and playback and, more specifically, to 
methods for managing digital image content stored in the portable display system. 
BACKGROUND OF THE INVENTION 

Portable display systems are fi-equently used to display digital 
image content such as still images, image sequences, streams of image content 
and/or text and graphics. Often, such systems are also capable of generating 
audible signals based upon audio content such as audio content that is associated 
with the image content. For example, Digital Versatile Disk (DVD) players are 
known that are capable of reading data from an optical disc containing image 
content and associated audio and converting this image content and audio data 
into human viewable and audible form. These systems are typically used in 
conjunction with commercially produced optical disks such as feature length 
motion pictures and audio disks. Advanced computer users and the owners of 
currently expensive home electronic optical disk recorders also can create optical 
disks having personally selected image content and audio collections. However, 
such optical discs are often time consuming for home users to produce and edit, 
for example, to include new content. Accordingly, even when home users 
produce optical disks having personal content stored thereon, the personal content 
often quickly becomes outdated. What is needed therefore is a portable video 
player that is capable of receiving personal image and audio content and updating 
this content in a simple and efficient manner. 

Thus, portable systems having rewritable semi-conductor memory, 
and so-called hard disks, are therefore preferred for use in portable digital display 
devices. However, the high cost of such types of rewriteable memory has 
traditionally prohibited the use of such memory in a portable display device. 
Recently however, there has been a rapid increase in storage sizes and a 
concomitant reduction in the cost of various forms of rewritable memory. 
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Accordingly, an increasing number of portable display systems have been 
developed that are capable of carrying very large collections of image and/or 
audio content. A user typically exchanges image content and/or audio content 
with the rewriteable memory in such portable display systems using a computer 
5 system such as a personal computer. In this way, the personal computer can be 
used to provide user interface capabilities, processing power, customized 
automatic data transfer software, archival storage and commxmication capabilities 
to facilitate the process of exchanging image content and/or audio content with the 
rewritable memory in the digital display device. This makes the use of such 

10 devices significantly more attractive to consumers and a variety of products of this 
type are currently known. 

Examples of connmercially available portable display systems 
include the Archos AV320 handheld entertainment center sold by Archos, Inc., 
Irvine, CA, USA, the eFilm Picture? AD tm sold by Delkin Devices, Inc. Poway, 

15 CA, USA and the ViewSonic Personal Video Player, sold by ViewSonic 

Corporation, Walnut, CA, USA and the Sharp-AV 300 sold by Sharp Electronics 
Corporation Romeoville, IL U.S.A. Each of these players contain rewriteable 
memories that are large enough to store collections of image and audio content. 
These devices obtain content that has been captured and converted into digital 

20 form and selected units can obtain content by way of capture. For example, the 
AV300 has a docking station that enables audio and video signals to be input into 
the AV300 which records these signals. 

Further, such high capacity rewriteable memories are being 
incorporated into products such as personal digital assistants, digital cameras, and 

25 portable telephones and other devices that have video displays, enabling such 

devices to be used to store and present collections of image content. Examples of 
portable video players of this type include a personal digital assistant, the Palm 
Zire 71 sold by Palm Inc., Milpitas, CA, USA which is capable of presenting 
video content using, for example, software known as FireViewer sold by 

30 Firepad Inc, Costa Mesa, CA, USA. Other personal digital assistants use 

programs such as Windows media player, provided by Microsoft Corporation, 
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Redmond, WA, USA, Shockwave, QuickTime media player provided by Apple 
Computer, Cupertino, CA, USA, FlashPlayer provided by Macromedia Inc., San 
Francisco, CA, USA and/or players compatible with the standards set forth by the 
Moving Pictures Export Group such as such as MPEG-1, MPEG-2 or later 
5 versions of the MPEG standard to present image content and/or audio content 
stored therein. 

High capacity rewriteable memories that are capable of storing and 
sharing image content and/or audio content but that do not incorporate displays. 
Examples of this type of device include the Digital Wallet sold by Minds@work 

10 LLC, Irvine, CA USA, the EZ Digimagic DM220 portable CD-RW drive sold by 
and the Buslink Photo Bank sold by Buslink Inc. These devices typically function 
to provide a large portable memory that can store data captured by digital cameras 
and the like without using a personal computer. 

Despite the recent increase in the memory capacity of rewritable 

15 memories, the demands placed upon such rewritable memories continues to 
outstrip the available capacity. In particular, the use of image sequences and 
streaming image information rather than still images greatly increases the capacity 
requirements for rewritable memory in display and/or storage device. Further, the 
desire of many users to store significant collections of audio content also greatly 

20 increases the requirements for rewritable memory capacity. Thus, while the 

rewritable memory capacity available in a portable display device has increased 
greatly, consumers can find that they cannot always store as much content in such 
memory as they would like. Moreover many consumers are concerned that 
portable display and/or storage devices that incorporate such rewritable memory 

25 are too vulnerable to loss or destruction to serve as a consumer's only storage 
means for personal imagery. Thus, consumers often use devices such as the 
portable video display devices to store a limited collection of image and audio 
content and also use a personal computer to store an archival collection containing 
a complete collection of their content. 

30 While the personal computer provides a uniquely valuable way to 

store the image and audio content, such an arrangement requires a meaningful 



amount of oversight and active data management. For the personal computer to 
act as an archive for the image and audio content stored on the rewritable memory 
of a portable display device it is necessary to maintain both a collection of image 
content and/or audio content on the portable display device and the collection of 
image content and/or audio content on the personal computer. 

The management of file transfers between rewritable memory in a 
portable display device can be controlled manually as is described in Publication 
No. US 2003/0063196 Al entitled "Handheld Portable Interactive Data Storage 
Device" filed on May 8, 2000, The '196 publication describes a portable 
interactive data storage device that includes a disk drive, a microprocessor, a USB 
port, and a data storage card slot. The device also includes a small liquid crystal 
matrix display and a small number of user controls. The device of the ' 1 96 
publication is configured for data storage, rather than as a small general purpose 
computer, and preferably does not include a keyboard. This device is capable of 
receiving digital image content and/or audio content not only from a personal 
computer but also from other sources of data such as memory cards provided by 
other devices. In this regard, the data storage card slot is configured to accept 
small data storage cards, such as flash memory PC cards or CompactFlash cards 
through a PC card adapter. The disk drive has a substantially larger capacity than 
the data storage cards. For example, using the storage a user loads data onto a 
data storage card using a portable electronic device, such as a digital camera. The 
user then inserts the card into the storage device and uploads the data to the disk 
drive. The card can then be repeatedly reused in the digital camera by uploading 
the data to the storage device after each use. 

Eventually, the user returns to a computer and connects the storage 
device to the computer through the USB port and uploads the accumulated data 
such as digital image content and/or digital audio in MP3 form to the computer. 
The device acts as a conventional disk drive and is managed by the user of the 
computer in this manner with data being transferred between the device and the 
computer as the user would transfer the data between two drives on the personal 
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computer. This method of transfer, however, requires user involvement at all 
stages in the data transfer which can be tedious and challenging for some users. 

Typically this challenge has been addressed in the art using 
synchronization software located on the personal computer. The synchronization 
5 software builds a database on the personal computer that is a virtual copy of the 
database in the memory of the portable device. That is, a generally exact copy of 
the data stored in the display device is also stored on the personal computer. 
Thus, to alter what is stored on the display device it is necessary to manually make 
changes to the database in the personal computer. What is needed is a more 

10 automated way to manage such databases. 

This need is particularly acute when a user wishes to effectively 
extend the amount of content that can be stored on the portable device by 
modifying image and/or audio content so that content is stored on the rewritable 
memory of the portable display device in a manner that reduces the amount of 

1 5 memory that is required to store this content. Typically, such modifications are 
made in a manner that is intended to reduce the amoxmt of storage capacity used to 
store the information without reducing the apparent quality of the content as 
presented by the portable display device. For example, when a user of the 
FireViewer software wishes to store image content on a Palm Zire 71 for 

20 presentation using the FireVewer software, the user will process the content using 
software known as Fire Converter also provided by FirePad, Inc. This software 
converts images and image content into a form that is adapted for presentation 
using the display system incorporated in the Palm Zire 71 . Because this Palm Zire 
71 has a display having an imaging resolution that is significantly smaller than the 

25 ^ imaging resolution typically found in digital images and/or sequences of images 
and/or streams of image information, the FireConverter software can process 
image content to form a lower resolution version of this content that can be stored 
on the Palm Zire 71 in rewritable memory. This lower resolution version uses less 
rewritable memory than would be used had the original image content been 

30 directly downloaded to the Palm Zire 71 . In this way, the data storage 

requirements associated with image content can be effectively reduced when such 
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content is stored in the portable device. 

However, when using existing software, the archival image content 
must be manually converted, manually identified for download to the portable 
display device, and manually organized for viewing on the hand held device. 
5 Further, to the extent that the archival image content converted by the 

FireConverter was conveyed to the computer using the Palm Zire 71, it is likely 
that the user of the Palm Zire 71 will want to replace the archival image content 
data with the converted image content. The removal of the archival image content 
is also performed manually. 

10 Thus what is needed is a more automated method for accessing, 

exchanging and processing image content and audio content data that permits a 
user to use a portable display device to store a large collection of image content 
and/or audio content on a portable display device in a manner that conserves 
available memory in the display device. A further need is for independent data 

15 archiving and a more automated method for extracting acquired image content 
fi-om a display device, processing this acquired content for use by the display 
device and conveying the acquired content to the display device in a useful 
manner. What is also needed is a method for managing acquired content that 
more fully automates the storage, presentation, organization and format of 

20 acquired content stored on the display device. 

SUMMARY OF THE INVENTION 
In one aspect of the invention, a digital display device is provided. 
The display device has a communication interface adapted to communicate with 
an archival storage device, a content source adapted to acquire content in an 

25 acquisition form, a presentation system for presenting content in a form that is 
different from the acquisition form and a memory for storing content. A 
controller is provided and is adapted to receive acquired content from the content 
source to form presentation content that corresponds to the acquired content said 
presentation content adapted for presentation using the presentation system and to 

30 cause the acquired image content and the corresponding presentation content to be 
stored in the memory. The controller is further adapted to cause the 
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communication interface to transfer acquired content to the archival storage 
device and to delete the transferred acquired content from the memory. 

In another aspect of the invention what is provided is a digital 
imaging system. The digital imaging system comprises a display device having a 
5 source of image content adapted to acquire image content in an acquisition form, a 
controller to temporarily store the image content in the acquisition form in a 
display device memory, a display for presenting image content, and a 
communication interface adapted to exchange the acquired image content with an 
archival storage device. The archival storage device has a processor that is 

10 adapted to automatically input the image content from the display device, to store 
the acquired image content in an archival memory, and to automatically signal the 
display device when the acquired image content is stored in the archival memory. 
Where the acquired image content is converted into presentation content that is in 
a form that is different from the acquisition form, the presentation content is 

15 stored in the display device memory, and the display device is adapted to 

automatically receive the signal from the archival storage device and to delete the 
acquired image content from the display device memory in response to the signal. 

In still another aspect of the invention, a method is provided for 
operating a display system having a display and a memory. In accordance with 

20 this method, image content is acquired having an acquisition form and the image 
content is stored in the memory. The acquired image content is processed to form 
presentation image content having form adapted for presentation on the display. 
The presentation image content is stored in the memory. The acquired image 
content is transferred to an archival storage device; and the acquired image 

25 content is deleted from the memory. 

BRIEF DESCRIPTION OF THE DRAWINGS 
Fig. 1 is a block diagram of a display device according to the 
present invention; 

Fig. 2 is a block diagram of a digital image acquisition, storage, 

30 and display system according to the present invention; 
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Fig. 3 is a flow diagram showing a method for operating a digital 
image acxjuisition, storage, and display system according to the present invention; 

Fig. 4 shows a back view of an embodiment of a display device; 
Fig. 5 shows a perspective view of an embodiment of a display 
5 device in the form of a multi-media display device; 

Fig. 6 shows a front view of a display device in the form of a multi- 
media display device. 

DETAILED DESCRIPTION OF THE INVENTION 
Fig. 1 shows one embodiment of a digital display device 10 in 
10 accordance with the present invention. As is shown in Fig. 1, digital display 
device 10 comprises a controller 12, user interface 14, display 16, signal 
processor 18, source of content 20, an image capture system 22, a communication 
interface 24, a memory interface 26 and an internal memory 42. Controller 12 
controls the operation of display device 10. Controller 12 can comprise a 
1 5 microprocessor such as a programmable general purpose microprocessor, a 

dedicated micro-processor or micro-controller, or any other system that can be 
used to control operation of display device 10. 

Controller 12 cooperates with user interface 14 to allow display 
device 10 to interact with a user. User interface 14 can comprise any form of 
20 transducer or other device capable of receiving an input from a user and 

converting this input into a form that can be used by controller 12 in operating 
display device 10. For example, user interface 14 can comprise a touch screen 
input, a touch pad input, a 4-way switch, a 6-way switch, an 8-way switch, a 
stylus system, a trackball system, a joystick system, a voice recognition system, a 
25 gesture recognition system, affective sensing system, or other such systems. 

Controller 12 also cooperates with display 16 to cause display 16 
to present image content such as still images, sequences of still images, streams of 
image information text, symbols and graphics. Display 16 can comprise, for 
example, a color liquid crystal display (LCD), organic light emitting display 
30 (OLED) also known as an organic electroluminescent display (GELD) or other 
type of video display. Display 16 can be fixed to display device 10. Display 16 
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can also be separable from or separate from display device 10. In embodiments 
where display 14 is separable from or separate from display device 10, display 
device 10 and display 16 will each incorporate communication modules (not 
shown) capable of exchanging information that will allow controller 12 to control 
5 what is displayed on display 16. In other alternative embodiments, display device 
10 can have more than one display 16. In the embodiment of Fig. 1, a signal 
processor 18 is shown. In certain embodiments, controller 12 can use signal 
processor 18 to cause or to help cause images to be formed and presented on 
display 16. In this regard signal processor 18 can provide display driver 
10 ftinctions. 

Display device 10 can also have other displays 28 such as a 
segmented LCD or LED display, an LED or other visible display device which 
can also permit controller 12 to provide information to a user. This capability is 
used for a variety of purposes such as establishing modes of operation, indicating 

15 control settings, user preferences, and providing wamings and instructions to a 

user of display device 10. Other systems such as known systems and actuators for 
generating audio signals, vibrations, haptic feedback and other forms of signals 
can also be incorporated into display device 10 for use in providing information, 
feedback and wamings to the user of display device 10. Using display 16 and/or 

20 other displays 28, display device 10 can present image content as well as 
information such as the status and mode of operation of display device 10. 

Image content and/or audio content is supplied to display device 10 
by way of a source of content 20. In the embodiment shown in Fig. 1 , source of 
content 20 includes three different systems, an image capture system 22, a 

25 communication interface 24 and a memory interface 26. Image capture system 22 
comprises lens system 30 and an image sensing system 32. In operation, light 
from a scene is focused by lens system 30 and forms an image at image sensing 
system 32. Lens system 30 can have one or more elements, be of a fixed focus 
type or can be manually or automatically adjustable. Lens system 30 is optionally 

30 adjustable to provide a variable zoom that can be varied manually or 

automatically. Other known arrangements can be used for lens system 30. 
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Image sensing system 32 converts light that is focused onto lens 
system 30 into image signals representing an image of the scene. Image sensing 
system 32 can use for example an image sensor (not shown) having a charge 
couple device (CCD), a complementary metal oxide sensor (CMOS), or any other 
5 electronic image sensor known to those of ordinary skill in the art. 

Signal processor 18 receives the image signals from image sensing 
system 32 and processes these image signals to form image content. The image 
content can comprise one or more still images, multiple still images and/or a 
stream of apparently moving images such as a video segment. Where image 
10 content comprises a stream of apparently moving images, the image content can 
comprise image data stored in an interleaved or interlaced image form, a sequence 
of still images, and/or other forms known to those of skill in the art of digital 
video. 

Signal processor 1 8 can apply various image processing algorithms 

15 to the image signals when forming an image content. These algorithms can 
include, but are not limited to, color and exposure balancing, interpolation and 
compression. Where the image signal is in the form of an analog signal, signal 
processor 1 8 can also convert the analog signals into a digital form. 

An audio system 38 is provided. Audio system 38 includes a 

20 microphone (not shown) and conventional amplification and analog to digital 
conversion circuits known for converting audible sounds into digital signals. 
Digital audio signals captured by audio system 38 are provided to signal processor 
18. Signal processor 18 converts these audio signals into audio content in digital 
form. Where the audio content is captured in association with the image content, 

25 signal processor 1 8 automatically associates the image and audio content in a 
common digital file integrated with the image content. Audio system 38 also 
includes a speaker system and/or an audio output port to which a speaker or 
amplifier system can be joined for reproducing captured audio inputs and for 
reproducing, in audio form, audio signals acquired or generated in other ways. 

30 Source of content 20 can also provide image content and/or audio 

content that are captured by other devices and transferred to display device 1 0. 
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For example, source of content 20 can comprise a communication module such as 
communication interface 24 shown in Fig. 1 for communicating with a remote 
memory system (not shown). Communication interface 24 can be an optical, 
radio frequency or other transducer that converts image and other data into a form 
5 that can be conveyed to display device 10 by way of an optical signal, radio 
frequency signal or other form of signal. Examples of communication interface 
24 include, but are not limited to, a cellular telephone transceiver, an 802.1 1 
interface, a so called Blue Tooth transceiver, and an Infrared commimication 
transceiver. Communication interface 24 can also be used to acquire a digital 

10 image and other information from a host computer or network (not shown). 
Communication interface 24 can also optionally be adapted to acquire image 
and/or audio content from sources such as conventional radio and television 
signals and from digital radio and television signals. Communication interface 24 
can receive such content wirelessly or using circuit connections such as audio 

15 video cables containing image and/or audio content. 

Communication interface 24 can also receive signals containing 
information and instructions for execution by controller 12 including but not 
limited to, signals from a remote control device (not shown) such as a remote 
trigger button (not shown) and can operate display device 10 in accordance with 

20 such signals. 

Similarly, content that is captured or otherwise provided by another 
device can be stored on a removable memory 46 with removable memory 46 
being operatively joined to memory interface 26. Memory interface 26 can 
comprise a port controlled by controller 12 to access digital imagery, either 

25 through a storage device such as a Compact Flash card, or through an interface 
connection such as a Universal Serial Bus (USB) connection. Controller 12 and 
memory interface 26 are operable using techniques known in the art to extract 
image content and/or audio content from a removable card. 

It will be appreciated that, in the embodiment of Fig. 1, source of 

30 content 20 is shown having an image capture system 22, a communication 
interface 24 and a memory interface 26 for acquiring content. Such an 
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embodiment can comprise, for example, a digital camera or personal digital 
assistant having an image capture system such as the Palm Zire 71 . In other 
embodiments, source of content 20 can comprise these sources of content or 
combinations of more than one. For example, display device 10 can have a so\irce 
5 of content 20 having only a communication interface 24 for obtaining content. 
Examples of such a device include, but are not limited to, a personal digital 
assistant, a cellular telephone, and a portable display system. Alternatively, in 
another example, display device 10 can have source of content 20 having a 
communication interface 24 and a memory interface 26. 

10 Image content and/or audio content that is obtained from source of 

content 20 is then stored in internal memory 42. Internal memory 42 and 
removable memory card 46 can consist of any of a number of rewritable 
memories, for example, a solid-state memory. Compact Flash-Cards, or a non- 
solid-state memory, for example a miniature disk drive or an optical drive. 

15 Image content and/or audio content can be stored in a compressed 

form. For example where the digital image comprises a sequence of still images, 
the still images can be stored in a compressed form such as by using the JPEG 
(Joint Photographic Experts Group) ISO 10918-1 (ITU - T.81) standard. This 
JPEG compressed image data is stored using the so-called "Exif* image format 

20 defined in the Exchangeable Image File Format version 2.2 published by the 

Japan Electronics and Information Technology Industries Association JEITA CP- 
3451. Similarly, other compression systems such as the MPEG-4 (Motion 
Pictures Export Group) or Apple QuickTime ™ standard can be used to store 
digital image data in a video form. Other image compression and storage forms 

25 can be used. 

Fig. 2 shows one embodiment of an imaging system 48 of the 
present invention. As is shown in Figs. 1 and 2, display device 10 can obtain 
image content using image capture system 22, communication interface 24, and/or 
memory interface 26 to acquire images by way of capture and by way of 
30 communication with other sources of image content including, but not limited to, 
memory card 46, digital camera 50, handheld portable computer 52, or personal 



-13- 



computer 54, or communication network 56. As noted above, internal memory 42 
has a limited capacity for storing image and/or audio content. Accordingly, 
display device 10 is associated with an archival storage device 60 that can receive 
image and/or audio content from display device 10, and store this content. 
5 In the embodiment shown in Fig. 2, archival storage device 60 

comprises a conraiunication system 62, an archival system processor 66, an 
optional docking station 64, an archival storage memory 68, an optional display 
70 and user interface 72. One example of such an archival storage device 60 can 
be a conventional home computer running complementary software to interact 
10 with display system 10. 

Altematively, archival storage device 60 can be an online computer 
server programmed to interact with display device 10. Archival storage device 60 
can take other useful forms. Archival storage device 60 has a communication 
system 62. 

1 5 Archival storage device 60 uses conununication system 62 for 

communicating with display device 10. Communication system 62 can be 
adapted to communicate with display device 10 in a variety of ways. For 
example, communication system 62 can comprise an interface that permits a direct 
electrical, magnetic and/or optical connection to be made between communication 

20 interface 24 of display device 10 and conmiunication system 62 of archival 
storage device 60. One example of such a direct electrical connection is the 
Universal Serial Bus interface that is connected to display device 10. In the 
embodiment shown in Figs. 1 and 2, this occurs when display device 10 is inserted 
into an optional docking station 64 to which archival storage device 60 is 

25 connected. Docking station 64 provides a conraiunication link between display 
device 10 and archival storage device 60 and can optionally provide additional 
functionality such as additional user interfaces, printing and/or automatic 
archiving of image and/or audio content transferred from display device 1 0 to 
archival storage device 60 by way of docking station 64. 

30 Display device 10 and archival storage device 60 can establish a 

communication link using other conventional communication systems such as 
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radio frequency or other electro-magnetic or electro-optical wireless 
communication systems. A communication link between display device 10 and 
archival storage device 60 can also be established using a telecommunications 
network such as the intemet. 
5 After a communication link is established between display device 

10 and archival storage device 60, acquired content is copied from display device 
1 0 to archival storage device 60 and stored in archival storage memory 68. 
Archival system processor 66 automatically instructs communication system 62 to 
send a signal to display device 10 when acquired content is successfiiUy stored. 

10 Display device 10 receives this signal and ceases transfer of image and/or audio 
content. In this way, image and audio content can be acquired by display device 
10 and stored in an archival fashion for later use. 

Communication system 62 can also optionally be adapted to 
acquire image and/or audio content form sources other than display device 10. 

15 For example, communication system 62 and/or archival system processor 66 can 
be adapted to communicate with other devices and to acquire content therefrom. 
In this regard, conunxmication system 62 can be adapted to communicate directly 
with devices such as digital camera 50, handheld computer 52, personal computer 
54, commimication network 56 and/or a memory device such as memory card 46 

20 which can provide image and/or audio content to archival storage device 60. 

Archival storage device 60 optionally provides a display 70 and user interface 72 
to permit a user to manually view and/or modify image and/or audio content 
stored within archival storage memory 68 for example by editing the image 
content, organizing the content into collections, deleting, and/or renaming content 

25 files. 

Fig, 3 shows a block diagram illustrating one embodiment of a 
method for processing image and/or audio content. In accordance with this 
embodiment, image content is acquired by display device 10 (step 100). This can 
be done in any of the manners described above. For example, where a user of 
30 display device 10 takes display device 10 to a family reunion, images that are 

captured by other family members using other digital cameras, can be transferred 
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to display device 10 by storing such images on memory card 46 and functionally 
associating memory card 46 with memory interface 44. When controller 12 of 
display device 10 determines that such a functional association has been made, 
controller 12 causes a copy of the acquired image content and/or audio content 
5 stored on memory card 46 to be stored in internal memory 42 (step 102). User 
interface 14 can be used to selectively acquire specific image content stored in 
memory card 46, altematively, all content stored in memory card 46 can be 
transferred to memory 42. Signal processor 1 8 can be used in this process to 
convert image content files into a preferred form for storage in internal memory 
10 42. 

It will be appreciated that the image forming capabilities of 
existing displays are currently substantially lower than the image capturing 
resolution of existing image sensing systems. Accordingly, image content that is 
acquired by way of capture typically has more information than can be used in 

15 presenting this content on display 16. This extra information increases the amount 
of memory capacity required to store the image content without any concomitant 
benefit to the observer of the content. Further, acquired image content having 
extra information must be processed when it is to be presented, this increases the 
processing burdens placed upon controller 12 and signal processor 18 when a user 

20 of display device 10 causes acquired image content to be presented on display 16. 
This additional processing also increases the amount of delay between the time at 
which the user of display device 10 uses user interface 14 to indicate that content 
is to be presented and the time at which display device 10 actually presents the 
content. 

25 Thus, in the embodiment shown in Figs. 1 and 2, controller 12 

and/or signal processor 1 8 are adapted to convert such image content into a 
presentation form (step 104). For example, down sampling and other 
conventional techniques for reducing the overall imaging resolution can be used to 
form a presentation image content that is adapted for presentation on display 16. 

30 Resampling techniques such as are described in commonly assigned U.S. Pat. No. 
5,164,831 "Electronic Still Camera Providing Multi-Format Storage Of Full And 
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Reduced Resolution Images" filed by Kuchta et al., on March 15, 1990, can be 
used. For example, where display 16 has a predetermined display resolution, 
acquired image content can be converted into presentation image content that has 
a resolution that is at least 5 1 percent of the display resolution. In this way, 
5 presentation image content can be formed that has a relatively large size suitable 
for viewing on display 16. Other image content and/or audio content 
modifications can also be applied at this point to reduce the overall file size of 
data files containing presentation content. These include adjustments in color 
gamma, the number of colors in each image, the amount of compression used to 

10 package the content, the number of fi-ames of image information that are presented 
per second of streaming video and the like. The presentation content is stored in 
intemal memory 42 and used whenever a user requests that content be for 
presentation on the display (step 105). 

This has two beneficial effects, first, the presentation image content 

1 5 occupies a smaller portion of the memory capacity of intemal memory 42 than the 
acquired image content firom which it is formed, and second, the presentation 
content is readily available for presentation without requiring display device 10 to 
convert acquired image content into presentation content form each time that the 
acquired content is to be displayed. 

20 When acquired image content, and/or audio content and 

presentation content are stored in display device 10, (steps 102 and 104) this 
content is stored in a structured fashion (step 118). In one embodiment, the 
content is stored in a simple data directory of the type used in the Disk Operating 
System or other similar data directories with folders containing files organized by 

25 date and time of creation, by file name, or using some other file organization. In 
another embodiment more complex structures can be used to store data files 
containing acquired image content, audio content and/or presentation content. For 
example, data can be stored in intemal memory 42 in a fashion that separates 
acquired image content fi-om presentation content that corresponds to the acquired 

30 image content. 
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In one embodiment, internal memory 42 is partitioned into a 
portion containing a collection of presentation content that the user wishes to 
retain in display device 10 to provide a mobile collection of presentation content 
and into a portion that stores acquired image content, audio content and 

5 presentation content that has not yet been archived. In another embodiment, all 
acquired content is automatically converted into presentation content and the 
presentation content is stored in a permanent collection in internal memory 42 of 
display device 10. 

Similarly it will be appreciated that audio system 38 can only 

10 reproduce audio signals having certain characteristics while audio system 38 can 
be capable of acquiring audio with a much broader range of characteristics. 
Where display device 10 obtains image and audio content having, for example, 
audio signals encoded in a form adapted for presentation using a so-called 
surround sound system, audio system 38 may not be capable of reproducing such 

1 5 a signal because it lacks a number of speakers or a distribution of speakers that 
can only be made in a properly equipped environment. Similarly, audio content 
can be obtained that has a range of frequencies that cannot be reproduced using 
audio system 38. Accordingly, audio content such as audio content that is 
associated with the acquired image content can likewise be processed by 

20 controller 12 and signal processor 18 to form presentation content having a 

different form and that can be stored using less of the storage capacity of intemal 
memory 42. 

Data structures such as databases, indices and catalogs can be used 
to structure and store content in intemal memory 42 in the form of virtual photo 
25 and video albums. Such structures can be indexed based upon the substance of 
the content, the time and date of the content or other usefiil arrangements defined 
by the user of display device 10. 

The user of display device 10 operates user interface 14 to 
determine further actions (step 108). If the user chooses to present content, for 
30 example, using display 16 images, the presentation content in the form of image 
content can be presented (step 1 10) on display 16 and any associated audio can be 
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presented using audio system 38. Display 16 can display only one image or might 
display a sequence of still or motion images, according to the user's preferences. 

Eventually, the user of display device 10 establishes 
communication with archival storage device 60 (step 1 12) and acquired image 
5 content and audio content are transferred to the archival storage device 60 where 
they are stored (step 1 14). Any presentation image content and/or audio content 
corresponding to the acquired image content and stored in internal memory 42 of 
display device 10 will also be transferred to archival storage device 60 (step 1 14). 
While display device 10 and archival storage device 60 are 

10 connected, archival storage device 60 can also transfer any presentation image 
content that is stored in archival storage memory 68, but not stored in internal 
memory 42, to display device 10 (step 1 14). In this step, archival system 
processor 66 can determine whether a user of archival storage device 60 has made 
changes to any archival content stored on archival storage memory 68. Where 

15 such changes are found, archival system processor 66 can form presentation 
content that corresponds to this edited archival content and can substitute the 
newly formed presentation content for the old presentation content associated with 
an unedited form of the archival content and stored on display device 10. In this 
way, display device 10 maintains a catalog of presentation content that 

20 corresponds to the current version of acquired content stored in archival storage 
memory 68. Archival storage device 60 can also update any organizational 
changes that have been made in the way in which archival storage device 60 stores 
acquired content but not in display device 10 (step 116). In this way, display 
device 10 organizes presentation content in a way that reflects the organization of 

25 content in archival storage device 60. 

As is shown in Fig. 2, archival storage device 60 also acquires 
image content from a second display device 74. Where this occurs, image and/or 
audio content within archival storage device 60 can be divided into groups, with 
each group associated with one of display device 10 and display device 70 so that 

30 one archival storage device 60, for example, can support independent users having 
separate display devices 10 and 74 while maintaining the content in the archival 
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storage device private for each user. Alternatively, all content may be accessible 
to both display devices 10 and 74, so that, in effect, each display device has a 
separate copy of the archive. It is also possible that some of the digital image 
groups can be accessible to more than one display device and other groups to be 
5 accessible to only one, or to none. In this way, controlled sharing of content 
among multiple users of archival storage device 60 can be provided. 

It will be appreciated that archival storage device 60 can 
discriminate between individual display devices such as between display device 
10 and second display device 74 based upon, for example, identifiers such as a 

10 device identification signal or user identification signal that can be transmitted 
fi-om display device 10 and second display device 74 to archival storage device 
60. This allows archival storage device 60 to select content to be received or 
transmitted to a display device with which eirchival storage device 60 has 
established a communications link. For example, as noted above, image content 

15 can be transferred to display device 10 and second display device 74 from selected 
ones of groups of image content stored in archival imaging device 60. Similarly, 
archival storage device 60 can, itself, have an identifier that is used by display 
device 10 and second display device 74 to determine the nature of the interaction 
between display device 10, second display device 74 and archival storage device 

20 60. For example, as noted above, in the embodiment of Fig. 3, archival storage 
device 60 transmits a signal to display device 10 indicating that archival images 
are to be deleted, and, in the embodiment shown, display device 10 automatically 
deletes the archival images in response to this signal. However, second display 
device 74 can be adapted to perform this automatic deletion in response to the 

25 signal only when the signal is generated by an archival storage device 60 having a 
particular identifier. In this way, display device 10 can upload acquired image 
content to a non-preferred archival storage device (not shown) without risk that 
the acquired image content will be automatically deleted before the acquired 
content is uploaded to a preferred archival storage device 60. 

30 In one alternative embodiment, the step of converting acquired 

image content and/or audio content (step 104) is performed by display device 10 
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only where display device 10 is called upon to present the content prior to 
establishing communication between display device 10 and archival storage 
device 60. In this way, the battery capacity and memory capacity of display 
device 10 can be conserved in situations where it is not necessary to present the 

5 image and/or audio content before display device 10 communicates with archival 
storage device 60. Where this is done, archival storage device 60 can 
automatically detect any acquired content that is not associated with presentation 
content, can form the presentation content, and can transmit this presentation 
content to display device 10. 

10 In another alternative embodiment, an additional step of deleting 

stored presentation content can be performed automatically by display device 10. 
This can occur where a user wishes to store additional acquired content and there 
is insufficient memory to store the additional acquired content in addition to the 
currently stored acquired content and presentation content. When this situation 

1 5 occurs, a portion of the presentation content can be deleted to make additional 
memory capacity available. 

Similarly, the step of storing presentation content (step 105) can be 
omitted where controller 12 of display device 10 determines that the presentation 
content corresponding to acquired content carmot be stored in the memory 

20 available in imaging device 10. 

In still another embodiment, display device 10 and archival storage 
device 60 can be adapted so that presentation content is automatically preserved in 
of display device 10 only where the presentation content corresponds to acquired 
content that the user of display device 10 has asked to be presented before the 

25 display device 10 is connected to archival storage device 60. This helps to 

conserve on the amount of memory capacity used to store presentation content by 
limiting the content stored in display device 10 to that content that the user has 
indicated an interest in by causing it to be presented by display device 10 between 
the time that display device 1 0 acquires the content and the time that a 

30 communication link is established between display device 10 and archival storage 
device 60. 
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It will be appreciated that in certain situations display device 10 
can act as an archival storage device for another display device. For example, 
display device 10 can be operable in a mode wherein display device 10 receives 
acquisition content from display device 74 and transmits a signal that causes 
5 display device 74 to discard the acquired content while also causing presentation 
content corresponding to the content discarded by display device 74 to be retained 
in display device 74. 

Display device 10 can take many forms and can be incorporated in 
various conventional devices. For example, display device 10 can take the form 

10 of a digital camera 130, one embodiment of which is shown in Fig. 4, and a multi- 
media device 140 shown in Figs. 5 and 6. Other examples of forms of display 
device 10 include, but are note limited to, a personal digital assistant, a cellular 
telephone, a television, and/or other devices. 

In a further embodiment of the invention, controller 12 stores data 

1 5 indicating the number of times that a user of display device 1 0 uses user interface 
14 to request that particular content be presented using display device 10. This 
information can be used as an indication of the user's interest in the content. The 
nvimber of request data can be stored in association with the acquired content 
and/or display content as metadata and can also be stored separately. The number 

20 of request data can also be transferred with acquired content and/or display 

content to archival storage device 60 which can also maintain a record of number 
of request data and this record can be updated each time display device 10 
establishes communication with archival storage device 60. 

Similarly, the number of times that acquired content and/or display 

25 content stored on archival storage device 60 is presented can be recorded by 
archival system processor 66 and included in the number of request data. 

The number of request data can be associated with time of request 
information. This provides a way to discriminate between content that was of 
high interest at one time but that has not recently been of interest. There are a 

30 variety of ways in which this can be done. In one embodiment, this is done by 
controller 12 recording date and/or time information in association with the 
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number of request data. In such an embodiment the number of request data can 
comprise a file that contains dates and times with each separate date and time 
entry being regarded as a separate request for the purposes of determining the 
number of requests. Altematively, controller 12 can simply increment a number 
5 of requests counter that is associated with display content stored on display device 
10. When this coimter information is transferred to archival storage device 60, 
archival storage device 60 detects changes in the counter information for the 
content and records date and/or time data indicating the number of time that the 
content has been presented since the last time that the same content was uploaded. 

10 This provides a less precise but still usefiil indication of the level of continuing 
interest in selected content. 

The number of request data and/or time data associated with the 
number of request data can be used for a variety of purposes. For example, 
controller 12 can assemble a relatively short list of favorite content based upon the 

1 5 number of request data. For example, the favorites list can contain a set of content 
that has the highest number of requests, or the highest number of requests within 
the past few days, weeks or months. Display device 10 makes such content easily 
accessible to the user of display device 10. In this example user interface 14 can 
provide a favorites button 132 as shown in Fig. 4 that causes the camera 

20 embodiment 130 to call up a list of favorite contents from which the user can 
quickly select content for presentation. 

The number of request data and/or time data associated with the 
number of request data can also be used to select display content for removal fi-om 
display device 10 in circumstances where the portion of intemal memory 42 of 

25 display device 10 that is used by display content is filled, yet the user evidences a 
desire to continue to acquire content using display device 10. In this situation 
display content that has few requests or for which no recent requests for 
presentation have been made can be removed fi-om intemal memory 42. 

The invention has been described in detail with particular reference 

30 to certain preferred embodiments thereof, but it will be understood that variations 
and modifications can be effected within the spirit and scope of the invention. 
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100 acquire image content step 

1 02 transfer image content step 

1 04 convert acquired image content into presentation content 

106 store content step 

1 08 user decision step 

1 10 present presentation content step 

112 establish communication step 

114 transfer content step 

116 remove acquired content step 

118 update storage structure step 

130 camera 

132 "favorites" button 

1 40 multi-media device 



